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4BSTBACT . - 

This taper begins with a description of four 
generations of researclQ>n Biichine translation: the original efforts 
erf 19 57 to 1965 and thre^Types of surviving and soaetines coapeting 
present projects. The three types of present projects includcL those 
relying on "brute force" aethods ^avolving larget and faster 
coiputers; those based on a linguistic tradition nhich asserts that 
knowledge required for iachine translation can be assiailated to the 
structure of a graaaar-faased sysiea vitb a seaantic. coaponent; and 
those steaaing froa artifi^clal. intelligence research, with an 
eaphasis on knowledge stx;uctures.^ Tfa^ paper argues thtft the 
artificial intelligence approach haa/the best chance of siaulating 
the coaaunicative abilities necessary^ for realistic aachine 
translation and gives an account of ^ov knowledge structux;es sight 
cope vith one of the classic probleas of aacfaide translation: that of 
aetaphor, or "seaantic boundary breaking." \lh) , 
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4.. ' % • • -2. 

Abstract ' - ' * 

Although tho large Governnient Bupported Machine Translatioa (MT)^, . ^ * 

iSrojectp came to an end in the middle Sixties,, it was by no ^'eans . ^ 

the case that all MT research stopped at that time. Some large proje'Hs 
continued in Universities (particularly in Canjada), and some small cdmmercial ^ 

' ' companies continued with the n^ettiods'of the first geqe^^ation, but using larger 
dnd faster computers. The results of the^r persistence have appeared 
only in the last few years. Moreover, research workers in Artificial 

h Inteaiiegnce (AI) turnefl thciy attention to understanding natural language . 
' in some cases, to concrete problems of MT that required the .manipulation • 
*o[ meaxiing and of real world information' for their solution. ' | ^ 

*These latter three a-pproaches are all alive and well at the moment, 
and the paper -discussef? their abilities to cope with the difficult problems 



of MT'that were left unsolved by the first generStipn approaehes. fhe • 
bulk of the paper Argues that for'the long term|^uture,^the AI approach 
^ has the best chance, of simulating the commyoicatiVa abilities that will 
be required for reajistic *and general MT,N^and proceeds to gij^e some 
account of how large scale knowledge struc'tui'es might begin to cope with 
one of the classic pro^ems of MT: that of metaphor, or "semantic 
boundary breakifig'\ 

\ / . - 
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Introduction 

<r ' ' ' " ^ • ' ' . 

* . There is an gncient Chinese curse that doonris recipients to live 

) ' ' ■■ ' ' ^ 

In an Interesting a^, and by those standards Machine Translation (MT) 

workers are at present having a-bad time. TJie reason things are ipterestlng 

at the moment is\hat there is a number of conflicting iclaims in the air 

about how to do MT, an<i!>^hether it caa, or Indeed has already, been done. ^ 

Such a situation is unstable, and we may confidently expect some kind of 

• outcome— :always cheering for the empiricist— In the near future. 



ERIC 



What has happened is threefold. First, the ."brute force" methods . 
• for MT, that were thought to have been brought to an effd by the ALPAC (1966) 

• Report have surfaced again, like some Coelacanth from the (Jeep,, long 

. believed exli«ct. Such syBtem§ are now being sold under such trade names •. 

as LOGOS. XYZYX; SMART ancT SYSTR A;^; and the last, and berst kno^'n, 
^ is now undergoing extensive testing in Paps- (Etat 1^976^ and-Luxembourg. 

. Secondly, some large-scale, more theor^ically based, MT projects., 
contiftbed— usiially based in Universities — and ^re now being tested tn use, 
though sometimes on ?. scale smaller than that originally envisaged. METEG, 

> , ► * ' 

for example, in Montreal (Chaiidioux, 1976), which was to have translated 
- official dociimuments from English to French, Is now in use for the translation 
of the more limited world of TV Weather reports. 

' ' * \< ' 

* Thirdly, workers in natural- language In the field known as Artificial 

Intelligence (AI) have begun to make' distinct claims about the need for their- 

• approaph if there is to be general' an^high quality MT (Wllka, 1973; Charnlak. 
' • . . "4' ' 



1073;. .Scbanlc. pS). Small pilot syslems illljslrating their cUlms have ^, 
' been-programmed., but their role in contemporary discussion is mainly of 
a, theoretical nalure, ^ ' . ' 



' However, these are not merely thfee complementary 'approaphes, 



^ fof^they seem to be maidng differenf claims, and. unless we take the easy- 
way out and^simply.define some level of At appropriate to each ojthe^ 



entei-prises, it seems they cannot all be right; and that we may hope for 

"some resoTlution before too long. 

f 



What i shall> iri this brief pajjsr is to sketch the recent backgroond 
from the.AI point of yie^V. and then outlijie vecy brieHy a development within . • % 
the overall Al approach tljat should hav^/ome b^aHn- on the possibility of 
higli quality MT. ' ' 

« 

Some backg^round notes 

^ . / 

'^B the title hints and the Introdudlon sets out. We now have, in my 

•view.- {OUT generations of MT research: the original efforts of 1957-65 plus . ' 
the three'types of project now surviving, and indeed competing. Tlje/key ' 
to their relation can b^ found in Ih^r different responses to- Bar-njUes's 
critique of MT, ^^hich he upefated at intervals, but which came dowiko one 
essential point; MT is^not'only practically^but theoretically. imix)&6lbte. 



"Expert human translators use their baclcgrou nd knowledge, mostly. 
^ subco^nsciously, In order to resolve sylactioal and semlliftal ambiguities' 
which jpa^e will cither hav« to leave unresolved, 6r r^olve by some 

ERIC ' , ' 



cr 



"mechanlcaU* rule which wilt evea so often* rb&ult In a y^rong translation.* 
^The perhaps simplest lUuBlratlon.of a syntacXlcal ambiguity which Is unresolvable' 
by a machine except by arbitrary or ad hoc rujes Is provided by a sentence, 
say • . slow neutrons and protons* • • • have no dltflculty in resolving 
the ambiguity through utilization of his background knowledge, no counterpart 
of which could possible stand at the dlsposaj of Qomputers, (Bar Hillel, 1962).^ 



The imnicdlate conta^ of Bar Hillel's argument was the performance ^ 
of early syntax analysers which, according to legend, were capable 6f producing 
upwards to of ten- parsings of sentences like 'Time flies like aaarrow^', where, 
with respect to standard dictionary information, any of the first three words 
could be talcen as a possible verb. 



=.The standard reaction to such syntactic results was to^Srgue that 
this simply showed the need for linguisrtic semantics, so as to reduce the ' 
^Veadings'' in such cases to the appropriate one. Bar Hillers addition t6 
this was to argue that it was not a matter of semantic addi^ons at all but 
of the, for him unformalizable, world of hu^ian knowledge. 

It is interesting to notice that^he reactiohs o\ Bar HlUel and AT 
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workers like Minskyj^re^ln part the ^anne: (Minsky, 1968).argtied that 

' MT clearly required.^fe formalization of human knowledge for-a system 

_ •«> • 

that could be said^tn unrlerstand, or as Bar Hillel reviewed the situation 

ill 1971 (lehmann & Sli^liowttz, 1971, p-73), 

"It is now almost generally agreod^ipon that high-quality MT is 

Q ' po*sslble only when the text to W-transIatcd has been understood, in-ln 



*appro]/-iate fich^se, h'y Ihc translating nl^cchanism'^ G*" 



What Minsky and Bap-Hillel disa greed about, of couree, was what ^ 
'-followed; 'Bar-HUlel tWught that the impossibility df MT followed, whereas 
' Minsky believed that the task had now been defined,' and the job of AI was to 

--■■.»■ 

• get orf with it. * • • 



The contrast'! s clear between these tyo and the views of linguists; 

Chomsky's generative theories are also, in a clear sense,' a reaction to the 

failure of early MT, in that they state vAth great force the case for a solid 

Ihedry oK^^natural languages as a precondition for any advance with machines 

and language. Fodor-fc Katz^s semgntic^, adjoined to a generative grammar, 

represent, as it were,' the linguistic analogue to those who thought that 

semantio information would resolve tlie mutliple parsings of the notorious 

"Time flies like a'lrow'^ Later linguists broke from the Chomskyan 

paradigm l)y frrguing that Fodor % Katz^s*rigid exclusion of human knowledge 

froma linguistic system was Inadequate, and that many forms of Jjfagmatic 

^ '"ft 
'knowledge would be required in a full linguistic system. Lelimann - 

^tacho\vUz/(3 971) contains contributions along these lines from Jloss and 

Fillmpre, specifically in relation to MT. * ^ 



li to respon d^Dar-Hillerg 



The attempt by AI researcli to respond^to Dar-Iiillers challenge i 

is of ^ different sort. ,It is an attempt not only to admit ab Initio the need 

' ^ 

for 'T<nowledge-structures" in an understanding system, but also to foiWulate 
thcories'and systems containing processes for the manipulation of that 
knowledge. ^Trocesses" here is not to be taken to mean merely progrStmming 
a computer to carry out a task, for many Al systems of interest have either 
not been progran^med at aU or made to do only partial demonstrations. -The 



word '"process*' means that a theory of understanding should be stated ln 

. '-S ' . • - 

as symbol processing manner, one in which most linguistic theories are 

f ' ■ 

noWnfarmation processing. This Is a contentious position, in that ^nerative 
grammar has been in some sense a description of a proces«[pBinc^ the'eacrliest 
descrieJions of transformational theory. The AI ca&e is that it never quite 
comps up to scratch in processing, terms. The nature of-4bis dispute can 
be seen from 6uch work as (Bresnan 1976) where an attempt is made to 
present transformational grammar at the highest level in an unfamiliar 
(to linguists) and process-orientated manner. ^ ^ 

The METEO system represents what one might call the linguistic 

tradition in MT works: with claim -that an MT system based on a liyaistic 

f 

theory is sufficielit. and that wiiatever knowledge is required for MT can 

* j 
be asfeimlLated to the structure of a gramma-r-based system with a semantic 

coiaaponent. ^ ' >, * 

" The work of ^oss and Fiflmore referred to* (as well by Lakoff and 

*^ • 'V • ■ - . 

McCawIey among others) represents a breakdown of the paradigm that has 
dortainated linguistics since 1957, and in their search for-more general . 
notions of process to express knowledge computations it is no longer clear 
^that anything fundamental separates them from what we -have herQ called* 
the AI approach to MT. ^ - • 

The additi(^rial contrast with the rc&urrccted "brute force'* methods^ 
should now be clearer. These approaches have in essence if^nored t)ie challenge 
of Bar-Hillcl as well as the earlier one from linguistics for a theoretically 
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motivated syntax a^d semantics. The assumption behii^ work like SYlSTRAN 
Is that the main fault of.the early^MT period was inadequate machines and - ' 
software, not theory t The. striking demcyistratlons* given of that system 
are not yet conclusive, -and detailed descriptions of its ^ethods are not 
available, bccaufse of understandable commercial considerations, but there 
can be no dqubt that it does pose a considerable' challenge to both linguists- 
and Al theoreists, ^f/ho claim, in their different ways that some higher ' 
level thed'ry is essential for MT. 

What then^an AI theory? ^ 

/ ' ' . ^ ^ 

V - Apart from their common efmphasls on knowledge structures and 

^ J \ ^ . * 

^^pirocess form, AI tfieories can only be Illustrated by Example, since they ' 

differ so much amo'ng themselves on a wide range of issues (see Wilks, 1976c). 

Moreover, MT is not usually the implementation enviromifent of a typical AI * 

program ^though see Wilks, 1973; 1975) which Is normally dialogue, question - 

answering or paraphrase. But no issue of principle arises here, especially 

if onb accepts Sleiner's (1975) claim that ev6ry act of understanding is, in 

essence, pnc of irajtslation. , ^ 



^ Wlnograd*3 wcll-kno^vn ^program (1972) was perhaps the first AI 
language understander not directed to what one coulcl call the classic residual 
problems of MT: word sense ambiguity, pronoun reprence ambiguity etc. 
^ Ue \yas concerned to show the role of knowledge of a microworld of blocks 
as a tool for resolving syntactic ambiguities in input tof^ dialogue system. 



^ * One at the University of Zurich, bc^fore Swiss acedemics and military 
•^n 12th June 1975 successfully translated 30, 000 of unknown text. ' 

^ ; ^r.^ , i 



So, for example, whenWs system saw the sentenceVptfrthe pyramid on 
the block ill t|ie box**, would Immediately resolve tha surface syntactlq 

*• \ ' r 

j ambiguity of tHSt comm'and according to wheth^is^fcert MAs a block either 
under a pyramid or already in the box in the blocks scene that it understood* - 

• More typical of an implicit. response to problems were the • 
systems of Schank, 1975a; Chamiak, 1973; and Wilks, 1975, which, in 
their different ways, were concerned with the semantic representations, 
real world knowledge and inference rules needed to understand various 
aspects of every-day story-like sentences, and to produce deep representations 
for them, from which translations in another .language could in principle 
. be produced. ' i ^ * ^ 

'In the last few years the paradigm in AI and lailguage understanding 

has itself shifted, largely in response to an argument (k Minsky'6 (1^75) 

that more complex knowledge stnactures were required than had been 
* - • 

contained in any of the systenns, mentioned so far* He called these more 
complex ^tructiifes*frames, ahd argued that without the more specific' 
knowledge of concepts that they expressed, lan^age* understanding would 
not be possible. • ' ' \ ' s 



* 



So far, as in (Schank, 197^b;. Chamiak, 1975) frames have been 
\ f ^ 

taken to be representations of stereotypical situations, such as the normal 

ft 

seque^nce of events in shopping in a supermarket, iie argues that we can 
easily construct^tories Uiat will not be understoocj without such knowledge: 

10 . 



"John put fome bacon in t^e basket in the supermajrket,; but then slipped 

/ . . • ' ^ * . ^ ' 

.a bar of chocolate qff. the feh^f iind into his pocket. * When ne got to the 

checkout his face went red and he said J didn't mean to lake it* He might 

argue that One cannot refer the ''it'* correctly in that sentence, and so 

.understand it or translate it \nto a suitably gen4^3?dered language. 



without the sequential knowledge of Avhat is and is not normaKin a supermarket. 
There is still gome unclarity shout what precisely are the claims implied 
by the use of such frames (see Wilks, 1977b), but there is no doubfthat they 
do represent a real form of^tanguage-related knowledge can be^een 
a-s a new attempt, to tackle the old MT problem of^pic. So, for example, 
Sphank has-a program for using restaurajrt^rames such that when It sels, ; ^ 
say, the word ^brdier" it will know that i^is the word "order foodM, because 
it is encountered in a^restaurant frames, and' not the more general '^rder 
an object". . , ' ' ^ * 

Schank has also supervised^the construction of a program that ' ^ 
reads stories ijito a frame format and then translates -but the whole frame 
(including the. stereotypical partfe mi actually men^lioned in the original 
story) in a number of different languages. * * 



V 



• . ^ In what remains" of this paper r would like to sketch a proposal for 
.the relevance of a rather different type of frame to a staftc and not 
a dynamic frame to. do with normal sequences^of^ctions. It is directed 
Ipwards another intractable problem of MT: of what Ip'do when the input 
does not fit our semantic expectations. " I will 'now turn to thtC^^and then 
finally maice some remarks about how far such AI proprfafals may l^e us 



in MT even when they eventually \^ork^a^Kprograni^ 



auis. -7- 
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~" MeanmgJjoiindarlcs and kn owlcdp^e structi^rps - • " ' 

' ■ ' The '■rcn>aiader ol" the da^e^ Sketches hbw one might deal with cxtertsiqn^ of ■ 

• word-sense in* natural I^'gti'ag^imjderstanding system that, is to say. 

• normal att^i-anqes 4|jat,^k-ai:.pre^ligneisel^ 'or preferencef^. > i;estnction8. ^ 
The proposlii'here extend'the knowledge representati^ of the preference/emanties 

'»NJ.US-(Wilks 1968, '1973, 1975) witli nseudo-texts (PTrwiiieh are frame structures 
' in the sense hi (Minsky 1975). but wliich also consistei>:/'ith the general 

• ' - assumptions of this NLUS. 



It is essential to see Uiat ^nded u_se, in the sense of piK^ferenee- violating , 
use'is the norm in ordinary langu^e use. ^d so e^inot be reTegated in an NLtJS ^ . 
to scuiie spQciafreaJm of treatment, as "perfprm^an6e" is in generative linguisties. 
nor neglected in a general consideration of MT. The following sentence is "chosen. 
I promise you. at random from-th^ front page'of a daily newspaper: < The Times .. ' 

5-2-76): 

(1) Mr. Wilson said that the line taken by the Shadow Cabinet. thErt a Assembly 
should be given no exoL^utive^powers Would lead to the brcak-u£of the 
United Kingdom. . ^ ^ • 



Th*e sentence presents no unders«mding problems whatever to an informed 

■ ' ' ■ ^ ^ ^ .' . / ' 

.reader, ycl each of the four md^mcd entities violates the normal^ preference 

restrictions of an associated verb: lines, for example.' would violate the normal 
ph/sical object"restriction on "take", ahd so on. 



12 



er|c - 



/ 



The process to%e described in this-efiper is called projection: we shall show 

ho)»f sense degcripUons for wo?ds can be re\\^ritten, 'in'*prefe'rcncc-viola'ttn^ texts 
' • ' *• ■ . * ■ 

^ )• with the aid of the specific knowledge in PT s: part of the PT will be^ 

projected intd the. sense description for,a word. So, for example, in (1 / some * 

detailed p61itic^ knowledgc"in a PT for "United Kingdom- could show that a breaking 

of that entity cbuld be caused, ahd wcNvould then replace the sense description- 

of "lead to" by one equivalent to "cau«e", thus over^zomin^S^^^^nce violation 

in, "lead to the break-up" and providing a more appW^^iate lWES!ynt.inn.nf- . ' 

"lead to" for mialys is- of the rest of this text.- . * \ 

Brief recap of py-efcfeocc semantics ' . ' ' • , V, 

•In previous papers I have described an NL^US in wfiich rules operate on semantic 
word-sense descriptions to build up text des<ir.^ions. The rules that insert sense 
(iescriptlons into tjaj(t descriptions are \xhat I have>^caHed "preferential": they 
seek preferred entities, but will accept tlie less preferred if net^egsary. A sense ' 
description. for the action "drinJc" might be the formula: , \ 



, • - , . , . »Ji ^ - 

fig.l • - . . ■ - ' 

_ * * * 

This is a foonal.^^ of semantic primitives expr^ing the meaning, of the ' 
• • • . action (see King and Wilks r977): tliat drinking is aCAUSuig tb-MOVE, preferably 
, • done by 2n;ANlmale SUCJect (-agent)sa«d to a liquid (FLOW STUFF), TO a particular^l^ 

ERIC . ' ' . 
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A SE-IANTIC Ft)RITJLA' FOR THE ACTICN OF DRI^.TCCNG. 



r^DVE CAUSE) 




THE ACriQN F0RI1ULA FOR DRINKLX IK'^ALLED AT THE (CENTRAL) ACTION NCDE 
OF A SUmmC TE''^PLA1E* of POFJ-tULAS FOP. "John drirxs beer". ^ 



figure 1 
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• ANImate aperture (THRU PART), aiid INto the SELF (=the ai^imate 4gent). For 
shoit we will'write (2) as ( drlnk,)^ Jhe text structures in the system are semantic 

r 

templates (together with semantic ties between them): a template is a network 

5 

of formulas, containing at least an agent, action and object formula,^ Thus the , 

template for *The adder drinks waterV will be written the+adder drinks water 

, for short wTiere the whofle of (2 ) is in fact at the central (action) node. 

V • , ■ 

'• f ■ 

'r'>The process of setting up the templates allows the formulas to compete to 
fill nodes in template.s. Thus the formula for the (snake-)adder goe^ to the agent 
node in the template above in preference to the (machine- )adder because (2 ) 
specifics, by (*ANI SUBJ),' that it prefers to be acco.mpanied in a template by^an 
a nimate a^cnt formula.. However, in the sentence: 
(3) My car drinlis gasoline 

, * - ^ 

the available formula ^or the first template node, namely ( car 1 , is not for an 

A 

animate entity, yet it is accepted because there is no competitor for the -position. - 

« 

THE PU^^POSE OF Tins PAPER IS TO SKETCH HOW THE SYSTEM MIGHT NOT 
MERELY ACCEPT SUCH A PREEERENCE-VIOLATING STRUCTURE FOR (3) 
BUT MIGHT ALSO INTERPRET IT. . - 

S ~— — — • f 

An important. later process is called extraction : template-like structures 
ar^ inferred and added to the tgxt representation even though they mateh nothing 
.in the. surface text. Thcy^r© ''deeper** inferences from tlie case structures of 
formulas m some actual template - whei-^ the case primitives are those under- 
--iined m (i?). Thus, to the template for (3), we would add s^extraction (in double 

i , . • • 

O 1 ^ 



scfuarc par.entliese^ ln abbreviated form): - f 

(4) (( gasoline in car ) j % ' \ ' ^ 

^ which is ah inference extracted frOin the containment subforxnula c^f (2), (SELF IN), 
Analogous extractions could be made for each case priml^e in each formula in 
tlje template for (3), ^ . 

/' • ' ^ ^ 

Since the prdgfammed ver&ion^f the system, reported ii) (Wilks 1975W a 
structural change (Wilks 1976d) has' allowed a wider, arid more- specific, form of 
expression in formulas by allov^ng thesaurus items , as w^l as primitives, to 
function m them. No problems are introduced b^domg this, provided that the 
thesaurus items arc also the^isfelves words in the 'dictionary, and so have their 
f{>xmulas defined elsewhere m Uieir turn. One advantage of this extension is to 
impose a thesaurus structure on the v/hole vocabulary , and so render its semantic 

expression more consistent; - . " 

>^ 

A thesaurus, like Rog ct, is simply an organisation of a voc^abulary into semi- 
synonyrnous*^:'ows, which are themselves classifiej^ hierarchically .under heads , 
and even mc^^ generally, sect-^ons. Thus. under som<i very general section name 




MOVE (=:motion) we would find hb«d<'two of which might be engine and ^ v^ icle. 
The forrrler might be the name of a row of ^tual types of engine: 
(5) =^ 525 engine: turbine, ii)ternal combustion, steam, .... ' ' ^ 

where the number simply indicates the seqiience position of engine In the thesaurus. 
It is no accident that the mobt general scclion ^names like MOVE can be idcntiflfed 
with the semantic primitives of the present system. 



Thfi organisation is imposed by requiring inclusion relations, between the 
formulas for word senses, *fcorresponding to the thesaurus relations of the words. / 
Thirs, all the words in the row (5) would have a common subpart to th^ir formulas, 
and that common subpart w<3uld be the dictionary form\iifefor "enginc*\ probably 
.expressing in primitives no more thaji "a^ thing used by humans to perform some 
task, and self~movmj[; m some way". If now thesaurus items' can be insetted 
in formulas we may expect a formula for "car" at leas't as" -specific as: \] 



(6) 



J 



Language houndarjes aiid j^roj^^Oii ^ * * 

Let US return to examples like (3) for which the systoni^oiistructs a terpplatc 

even thout^ii it contains a violated prcfeiencc, and ask what should an Intelligent 

^'system infc^r m such a Situation '>* I vvould su^^gest that cai^j can be -said to tlrink 

; in virtuc'of something: a^stem might already know about Uu-m, n/acmnly th?^ they ^ 

^ ' ' ' W , ^ 
, have a fluid (gas/petrol) injected mto thcn^ aiid they use that in order. to rujT. 

' That IS to say,^ the ^oi^^ram should have aeccii^ to a sufficiently rich knowledge 

. Structure to express lh(\fact that cars stand in a relation to a-parlicular fluids 



a relation that is of the 'isamc s^emantic structure'^ as the j^clatio^n which a • 
drinker normally stands to Ihc thing drunk. All that ni:xy i.ound obvious, but How 



'* The sytcm already deals, with certain preference violatiotis. such as those ^ 
' constitHtmg the crgative case paradigm ("The nammer broke the sindo>v"4: 
FR?r" -"^ee Wilks 197Cb) and certain i.'x"ampics Ukc "Joh got a shopk^', a class ^^entral 
HsMaa to Kiesbcck's thesis (sec Schank (cd. ) 1075),. |y ^ ' . • ^ ' \ ^ 
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else arc wa to acc6unt for the neturAlncss of but the relative unnaturalnesB 

' (an(/uninterpretability) of "My car chews gasoline"," axid, the mote distant, ♦ 

* • ,' 

* ' car carves the Sunday roast". One upshot of these proposals is to distihguish 
..plausible (with respect to a knowledg^^s.e) |)refer§nce violation from'.th^ 



implausible, ** ' , ^ ^ . 



The procedural upshot <i^f the above ^Wiguld be to replace' at least oge fq^'mula ^ 
' ' ' • \ \ > ^ 

*'in the'' te'nipU^to f or (a) v^itli hno!ii}Qr\ either coastructed by rulc^.^^^or drfiwn from 

the kno^lcd&e structure 1t£cl{, fo be' called.a. ps^Udottex.t (PT), Lei us now'postuU^tp 

' ^ - A •\ V . ' • 

that '"car" points f)oi'only lo-(i3), l.-e, [ ^af ] but that 1 .Car frntur'n points to: , 

"' ■ ■■ ' 



.• vV 



r 



'A V , 



■ This slrLPcture ik'calltd a r>6 uud'o- text "bet ause it is oi lu^t the sam e-format 

•as Uie te<:t rcnrescgtaf ions prod u c rd .bV the pi:csgnt NLU.s. it can bp cxtended to ■ 
r — : ' c"" — ■ ; '■ ' 

taste to express as muCh-bpcciflc lnfor^at,iDa about cars ris is thought appropriate - 



.' given thr- parser for the prebc'.ifc NLUS, it'rould even be input as a real text.abo^t 

'■ ■- ' \ . i ^ — ^ T : " ~ 

** An im^x)rta^.t asj>ect oi the' irUerpretation of (3) is idipma^, namely that the car 
' ■ usos'a lot of gas/pctrot. Tiub appeci of the meaning is hcyoud tJiis, or ; nuspect 
any, general infeicnee procedure. 

. ' o •** In a fullervvcrsic'i of this pap^r (Willis, 1977) 1 des(,ri5v the "rei^tiou of this 
ERIC work U, attcn.pls, sue. ...s" (Given 1%7), to give gcncrni rules for pivjcrtion: 
™" rules operating on the diclloaary'and independent of contexts oTuse. ^ g ^ 

^ ' - ' 



PART OP A PSEUDD-TCXr-^FOR "car", 




Sliquid 

,/ 

♦^Stube 




PO 



huran injects a litjuid 
2 using" a tuBe ' 

2 liquid .is in the car 

3 t.he ICengine the liquid 
•gj the ctr^&^es . ' - " ' ' 
J the huMBTi in the car noves* 

the hur.ian turns th^ \:})eel 

2 -?.e hu-nan-pses a selfcarjt 

)i:iTn the c!ar roves to a new spatial 
pcLpt. 



and so or. 



figure 3 



cars, i'he representation consists of the templates (explained loosely at the' right), • " 
together with the (sClf«-cxplar)atoryJ*case and cause ties between them. In the 
templates, p dumjny and * denotes' the formula ( car J, that points to this obj^t (7). 
Thev pi'efixed items. are thesaurus items, though I'lC engine" is simply a specific 
dictionary word pointing to its own formula - specificity is thus* a. matter of taste. 
So, for example,' the thi^saurus heaiS liquid could be replaced by the more explicit 
"gasoUne*^. Items in rohad parentheses remain In primitive form. It will be 
clear that the same information can be expressed in ^ numbej of different way?, 
and at different levels of g^erahty; though th^ spirit of (Minsky 1975) s\aggests 
that they shr)uld \jc as spocifjc as possible. The Lntentioirhcre is thaft'^I^HE 
PROCESSES-niAT OPEIWTE ON SUCH ExNTlTIES AS (7) SIIAL.L DE.iDENTICAL 
• - \YIT1I THOSE THAT MANIPULATE RE PRESE-NTATIOiNS DEmVED FRQ^ INPUT • 
TEXTS; The approacn is (l/a^ ine reverse of the convontionai one: we seek to 
. assimilate khov/ledge structures to text structures, rather thaai the reverse, on the 
. grounds thai/the loprescntation uf language is the difXiculfe task, ai^d th^t thQ. 
reprcserilation of kn o\% lodge as such makes no sense apart from that. 

•. /. ■ .-■ ■" ■ . . •■ 

We should note, loo, tJiat just as the tliosaurus structure ijaposes a containment 
relation on tlie formu];is -of co-row-member words, so it also imposes a hierarchical 
relationshipjon PTs: that for vchicle,-Tor exSm^le, will be a less specific version 
of (7). Further up the' thesaurus would be PTs for lUgij- level sections : that for 
* MAN would be highly complex, for example. But note Uicce is no "ioiieritance of ^ 

property" problem in Uiis system: the formula for "amputee" wo"u1d have head 
' MAN find woyld specify tlie loss of limbs. Any iniieriled pseudo-text from MAN - 
asserting "two legs" - would Ijc modified by (amputee) . 



The system now uses (7) to make a projection, ^sb as to derive an interpretation 
for (4), by seeking, in (7) templates matching the- source template [my+car drijoks 
gasoline ) : namely the first and fourth ^es'of*(7). The first match is in virtue 
K 'of the similarity of [ drink ) and {.jtinject ] - based on the expression in primitives, 
as in (2), of causing, a liquid to be in an entity of tlie same type as the agent. This ^ 
would allow us to confirm by projection, tl)je""humanness of the drinker", that 
has already been noted by earlier extraction* routines^ extracting out from the 
drink formula (2) jndopcndcntly of the PT (7). Howei^er, no projection is made 
at this stage onto [car] ^ (thougti it might be- later in the face of sentence after 
(4) like ^'His thirst is never slaked'^ that confirms the humanness projection) 
because in tlie case>^x)f violations of the preferences of actions, like "driiik" in 
(4), the system ALWAYS PREFERS TO MAKE A PROJECTION ONTO THE ACTION 
ITSELF IF IT CAN. The strong match detected is between the above template for 
(3) and the fourth line of (7) in virtue of the containment of (-^engine J in f car J , 
and by ( ^liquid ! of (gasoline) , which is evident in tlie formulas thehiselves. 
This rfcsulLs in the projection of the action node of th^fourth Iflie of (7), namely 

( use] , onto f drinlcj in the template for (3). This projection is taken to be 
strongly confirmed by^the match with the first line of (7), and is considered to 
carry ovo)^ more sense than any alternative projection. Tlie confirmation (of the 
match of the fourth line of (7) by the first line) is Meessary here, because 



Mees 
biWn 1 



( my+car4eaks gasoline J would also match the fouWn line, but no such projection 
would be appropriate. Conversely, no projection could be^made for *'My car drinks 

^ ^ r ( 

mud'.' from the fourth line, even with the confirmation of the first, The general 
/ 

■ . 'r ■ ■ - ■ - — — 

* cxtfactions, it wj I be; seen, differ from j)rojections m that they produce 
hew template-like entities, rather than, as herS^ replaciiig formulas inside 
existing templates, 

ERIC ' . . '-'^ 



rule for actioft projectidhs then ift: SEEK A PS§UDO-TEXT, AGENT OR 
OBJECT, WITH A TEMPLATE MATCfflNG ON AGENT AND OBJECT NODES. 
PROJECT TIflS , GENERALLY IF THERI^S Ai^OJ^ PSEUDO-TEXT TEMPLATE 
' 4 MATCH TO THE ACTION ITSELF, FOR ANOTKER TER^LATE IN THE SAME 
PSEUDO-TEXT. ' ' . ' 

.We may note in passing three interesting developmints of the above'^^^uggestion. 
j^st consider the more complex example prescnt&d by "a recent b^dliiie; (8) 
• Britain tries to escape Comni^ Market, • , * 

. Clearly, some projccftion' would be appropriate here, of huxnanness onto the 
<^ountry, and perhaps even ''prisonlikencss" onto the formula for the Common * 
Market, Thjesc might bo drawn from Ihe formula ^or '^escape*' aloiTB, by extraction 
and' without recourse 'to the pseudo-texts for either of the entities. Even if we 
did consult those entities, wc would find a historical accpunt of Britain joining , * 
but not of leaving. In such circumstances mere facts are not enough, even when 
highly structured. Wc miglit conceivably be able to project some notion 
f disas3o*ciateJ onto [escape) from the "Britain pseudo-text'^ given some 
new matchmg criterion that placed relevance above negation in such cases 
(i.e, would match f escape] with fas^ciate] or ( join ] .) / 



Secondly,' we might consider the problems presented by an example like: 
(9) J ifmQ what you mean. * 

Here the last clanse breaks the preference expressed in ( see ] for a physical 
objecti ' A system pi;ocedure will present the actual object of (9) to the top-level 
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template simply as the ^jj^tive SIGN (the primitive for symbols and intcnsional ^^J^ 
representations of them) which has been obtained, by extraction, from the preferred 
, object in I mean ) , Thus the system is effectively dealing with the template sequence 
( I see (SIGN) l(you niean (SIGN) ) ♦ But what could wS expect as a pseudo-text 

r 

for somethilig as general as SIGN, so to use the above procedures to project 
onto I see ) . If we take advantage of the hierarchical natt^e of the tliesaurus, 
we might expect pseudo-texts at the very*top level, associated with the section naijnes 
- pure primitives like SIGN just as specific pseudo-texts are associated with 
the lowest level items in tlie thesaurus - row members like "car*\ The pseudo- 
text for a prij^tive like SIGN would be wholly "core structural": it would consist 
of ho more than primitfve concatenations, in template fot-m, like MAN TiUNK 
^ SIGN*, tlie most, general Uiing tliat can be said about what is normally done to 
signs. However, even something as general as this njight suffice to project 
TIIINK cor; ectly onto | see 1 . The interesting generality would come from using 



i 



exactly the same projection procedufos on the most general pseudo-texts, like 
this, as on the 'most specific, like (7). . * . 

^ Thirdly, and this treated at length in Wilks (1977), we can consider a quite 
different %pe of pj'ojection for phrases like: ^ ^ . 

■4 

(10) a to^ lion , . , f 

This comes from a much discussed class of examples f plastic flower**, "stone 

horse" etc. ), where an obvious projection mechanism is to replace the head of 

*? 

the formula for tlie no\in (BEAST in'^[lion ) in (10) ) by the preferred object^ of 
predication In the qualifier - here *PHYSOB iifltoy) . This would be a very 

^ * those familiar with the system of VVilks (19G8, . 19Gr>a etc. ) will remember 
^ that tliese arc the *'b;ire template*' structures actually uscjd to obtain the 

initial template inalcli. The suggestion here is that the "knowledfee-aspect"'^ 
^ of Uxr.^i'> riighly-i;unf-jMl structures is to be found as the pseudo-texts of primitives 
en ir"" - as tlie latter function right at the top of the conceptual hierarchy imposed * 
mmmm^ by Uic thesaurus, - ^ ^ - . 



limited and general class 'of projec^ons, not requiring access to PTs, l^ut which 
might still provide a ^'projected formula*^ appropriate for examples like: . - 

(11) The cat walked round the toy lion. 

Then he came back and sniffed it. * ^ ' t * ^ , 

where we might be helped to refer '*he" and ^Ut*' correctly by the neW, projected, 
formula I lion ] wflose head was no longer BEAST, and which gbuld therefore 
no longer be the refereuce of "he" as a real lion would* be. 

o 

A more radical and interesting development would be the construction of , 
"PT repadking functions" specific to certain qualifiers. Thus, for example, 
such a function for "toy", if faced with the phrase "toy car" might repack (7) 
usiiig a gcnera^l rule to dclclo all constituent templates based on the action US^, 
as v/ell as alb those that are at^nd of a GO^L l^c, since toy cars cannot, normally, 
serve' human needs, i^ses and^ufposes. ^ ^ 
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Postscript ■ • . ... 

The above suggestions are, as should be clear, only in the pre-pro'gram 
Stage, but they will be implemented. 

r 

* * ' * . 

What I have tried to suggest lo|thls paper is that AI language programs 
do bear upon the traditional difficulties of MT, and often do 'so mor^ diriectly. 
than conventional linguistic theories, with their preoccupation with well- 
forrnedness, and with delimiting the class of all utterances of a language. . 

I have given the impression perhaps that all AI programs are concerned 
wath what could be called stratospheric considerations: the solution of the most 
general problems of language and understanding. That would be unfair: there 
is H numlxir of more task-oriented projects under construction, attempting 
to limit vocabulary and world knowledge to very limited domains, such as 
plumbing repair, say, so as to produce concrete resists while at the same 
lime appealing to very general philosophical principles (see Levin & Moore, 
1976). 

What all the AI projects, of whatever level, hfave in common is ail^ 
appeal to very general knowledge and principles, eoupled to the claim that 
MT work must Jake account of these if it is ever to achieve any^ generality 
and reliability. The reply to this claim, from experience with projects like 
SYSTRAN, is that the examples that make AI these paints are artificial 
and/or rnre, and they can be ignored for practical purposes. This is clearly 
an empirical dispute and open to test, which Is what makes the present, 
situation inferesting as I remarkecl at the beginning. 
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That much does depend on one's choice oi examples can be seen bjf,.. 
rbturolpg to those o.( the beginning: Har-Hil^l's "slow noutftna and protons" 
shoul^d be amenable to treatment by an expert "atomic physics frame", one 
no' ' more open'to the charge of "ad hocnsss" tl;an Is human's knowredge 
of physics -itself. Btit with the old favourite "Time flies like san arrow", 
things are not so clear. In terms of what,I called preferenceB, It may • i 
well be that the desired reading (where time does the flying) satisfies no ^ ^ 
more semantic prefer«uces tha|^ saj^the reading ^^re the flies like 
certain objects. Moreover, it is hard to imagine that aiji topic^determining 
frame could help here — one would hardly expect this slogan in any frame 
a^ut timc^, except as an arbitrary addition. Nothing that has come from ^ 
recent ^^speec^.h act" theorists in lin^istigs and philos«phy seems likely 
to help either. Perhaps, the only explanation of our competence with this 
•sentence is that we read it off- a list of clichfes for which we have the assigned 
readiQgs:, a.sad conclusion for all" Uieoreticaily-mattivated work, and.an 
awful fate for a long cherished example, ' 
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